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A Croup  l^uidorn- Access  (CI^J  uccess-control  discipline  for  a multi- 
access communication  channel  is  presented  and  studied.  A CRA  scheme 
uses  only  certain  channel  time-periods  to  allow  some  network  terminals  to 
transmit  their  inform.'it  ion-bear  iiiR  packets  on  a random-access  basis. 

'Hie  channel  can  thus  he  utilized  at  other  times  to  grant  access  to  other 
tcnninals,  or  other  message  ty])es,  by  apjilying,  as  appropriate,  group 
random-access,  reservation  or  fixed  access -cent rol  procedures.  CRA  schemes 
could  also  he  utilized  to  jirovide  channel  access  to  various  network  proto- 
col packets. 

The  average  packet  delay  under  a (1R.A  discipline  is  evaluated  by  a 
‘larkov  ratio  limit  theorem.  To  stabilize  the  channel,  the  GIIA  procedure 
is  controlled  dynamically  by  a control  policy  wliich  rejects  any  newly  ar- 
riving ixickets  within  certain  time-periods.  Studying  the  associated  ^larkov 
decision  problem,  the  optimal  control  policy  is  characterized  as  yielding 
a minimal  average  packet  delay  under  a prescribed  packet  probability  of 
rejection.  This  policy  is  shown  to  be  a single-threshold  scheme  for  which 
there  exists  a threshold  value  which  attains  the  minimum  probability  of 
rejection.  Perfomuance  curves  arc  presented  to  demonstrate  the  excellent 
delay- throughput  characteristics  induced  by  GR\  procedures. 
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1.  Intrixluct  ion  .mil  _Sys tern  Ik^scr  ipt  ion 

Iv'e  consider  ;i  limit  i nccess  brocidcast  ch.innel  of  capacity  C bps 
serving  a netwoik  of  tenninals.  A s.itellite  communication  channel,  a 
radio  channel  in  a terrcstri.il  radio  network  or  a commim icat ion  link  in 
a broadcast  line  comjmter  communication  serve  as  a few  ex.Tjnples.  The 
channel  utilizes  a repeater  (such  as  a satellite  transponder  or  a radio 
relay  st.ation)  to  enable  each  tcnninal  in  the  network  to  communicate 
(through  the  repeater)  with  any  other  terminal  (see  [1]).  Messages  trans- 
mitted by  the  terminals  are  directed,  through  the  channel  uplink,  to  the 
repeater.  The  latter  then  shifts  the  message  uplink  frequency -band  into 
a disjoint  downlink  frei(uency-h;md  and  broadcasts  the  messages  (so  that 
each  terminal  can  receive  any  signal  reflected  by  the  transmitter) 
through  the  downlink  channel  towards  the  network  terminals.  (Note  that 

no  schedulings  for  message  downlink  transmissions  are  required.)  j 

We  assume  a s>nchronized  structure.  Thus,  time  (referenced  w.r.t.  ' 

rejicater's  time)  is  divided  into  fixed-length  durations  of  x sec.  each,  ' 

called  slots.  /\n  appropriate  network  synchronization  procedure  is  used 

i 

to  .achieve  network  slot  synchronization.  Terminals  will  start  transmissions 
of  mess.ages  only  at  times  coinciding  with  starting  times  of  the  synchronized 
time  slots.  The  channel  is  characterized  hy  a propagation  del.ay  of  Rx 
sec.,  or  R slots.  Propagation  delays  are  of  the  order  of  milliseconds 
for  packet  radio  channels  and  around  0.25  sec.  for  satellite  channels, 
hcjch  terminal  message  is  considered  to  be  descril^ed  as  a packet  of  fixed- 
length  of  y * bits  (including  protocol,  information  and  parity-check  bits). 

P.'icket  transmission  time  across  the  channel  is  thus  (yc)  ’ sec.  We  set 

- 1 


X = (yc) 


(1.1) 
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so  that  a slot  iluration  is  equal  to  the  packet  transmission  time. 

We  consider  a network  oi  M terminals.  New  messages  arrive  at  the 
i th  terminal,  i=  1 ,2 , . . . , according  to  a Poisson  stream  of  intensity 

A.  . I'he  overall  network  message  (or  packet)  arrival  stre.'im  is  thus  a 

Poisson  point  process  with  intensity 

M. 

A = I A.  mess. /slot  . 
i=l 

Upon  tlie  arrival  of  a new  message,  a teniiinal  will  immediately  try  to 
gain  access  into  the  channel  for  this  message.  No  tcminal -buffer  capacity 
or  blocking  constraints  are  imposed.  fine  can  also  consider  a terminal  to 
]x)ssess  buffer  storage  for  only  a single  message,  and  subsequently  to  be 
blocked  for  new  arrivals  when  occupied.  However,  wlien  the  network  contains 
a large  number  of  active  bursty  terminals,  the  blocking  effects  would  be 
insignificant;  see  [1]. 

To  utilize  efficiently  the  bandwidth  of  such  a channel  and  grant 
acceptable  message  resjwnse  times  to  the  terminals  sharing  this  channel, 
one  needs  to  apply  an  appropriate  access-control  discipline.  Access -control 
procedures  employing  reservation  schemes  have  been  recently  studied  in  [1]. 
Using  tiiesc  schemes,  each  terminal  needs  to  tran.smit  a reservation  packet 
to  reserve  a slot  for  number  of  slots)  for  a newly  arrived  message.  Assum- 
ing a decentralized  control  mechanism,  each  terminal  (w'hile  receiving  the 
broadcasted  reservation  packets)  stores  in  its  own  queueing  table  the  pres- 
ent state  of  the  reservation  process,  being  subsecjuent ly  able  to  determine 
its  own  allocation  of  transmission  slots.  In  a centralized  control  mode, 
a central  controller  receives  all  the  reservation  packets  and  subsequently 
instructs  the  terminals  when  to  tran.smit  their  messages.  IKnamic  reserva- 
tion schemes,  considering  single  and  tnul t i -packet  messages,  are  shown  in 


I 


[11  to  yieUi  excel  lent  del;iy  throughput  perroniiance  characteristics,  over 
the  wliole  ranj^e  of  imxlerate  to  hiyh  network  tial't  ic  intensity  values. 

lor  low  network  traffic  intensity  values,  when  sinj^le-packet  highly 
bursty  temiinal  message  processes  are  considered,  a better  delay-throughput 
performance,  involving  a much  less  sophisticated  (distributed)  access- 
control  procedure,  can  be  achieved  by  a random-access  meclianism.  The 
latter  allows  terminals  to  use  the  channel  at  any  time  to  transmit  a newly 
arrived  packet.  If,  however,  two  or  more  jiackets  collide,  the  involved 
messages  are  retransmitted  following  an  appropriate  random  retransmission 
delay  policy.  Due  to  the  simple  distributed  control  mechanism  involved 
with  a random-access  discipline,  such  a procedure  can  result  in  significant 
savings  in  liardware  requirements  (such  as  those  involving  various  multi- 
plexing mechanisms),  protocol  and  system  complexities.  (See  [3]  and  the 
references  therein  for  the  use  of  a random  access  technique  in  the  \1.01L\ 
computer  communication  system.)  furthermore,  very  low  message-delay  values 
are  attained  when  a random-access  di.scipline  is  utilized,  provided  that 
low  enough  throughput  values  are  acceptable.  A simple  slotted  random- 
access  procedure,  called  slotted  AhOflA  (sec  (.3) -[8]),  is  noted  to  allow  a 
iiviximal  throughput  (channel  traffic  capacity)  of  1/e  = 0.3b8  packets/slot, 
llms , an  average  number  of  at  most  0.368  packets  will  be  successfully 
transmitted  through  the  channel  (compared  to  a channel  traffic  capacity  of 
1 packet/slot  for  HIMA  and  reservation  schemes,  see  [I]).  We  further  note 
that  a random-access  cliannel  needs  to  incorporate  a flow-control  mechanism 
to  avoid  instabilities. 

In  various  actual  situations,  the  designer  is  ready  to  accept  channel 
throughput  values  lower  than  1/e  , while  requiring  a simple  distributed 


access -control  |irocciluie.  A random -access  procediire,  such  as  ttie  slotted 
A1,(''IL'\  techni(iue,  is  tlien  an  attractive  choice.  In  many  cases,  one  desires 
to  detlicate  only  certain  portions  of  the  channel  time-frame  to  a family 
ol'  netuork  teniiinals  wishinj;  to  share  the  channel  (durin>t  tlu'se  periods) 
on  a random  access  l>asis.  for  that  purpose,  ue  present  and  study  in  this 
paper  the  (irou^  lt;nx[om  Access  ((iltA)  discipline.  Under  a fiRA  discipline, 
a j;roup  of  network  terminals  are  provideil  with  a periodic  sequence  of 
channel  access  jx'riods,  during  whicli  this  grouji  uses  a random-access 
discipline  to  gain  access  into  the  channel.  A packet  e.xperiencing  colli- 
sion during  a certain  [x?riod  will  he  retransmitted  during  the  next  access 
jK-riod.  Other  groups  of  network  terminal  (distinguished  by  their  priori- 
ties, fierformancc  requirements  or  by  the  statistics  and  nature  oi'  their 
information,  emitting,  for  example,  short- interactive  or  longer  long-haul 
messages)  can  share  the  remaining  time-frame  duration  using  again  ORA 
inocedures  or  other  access -control  tecluiiques. 

It  is  many  times  of  particular  interest  to  use  a ORA  procedure  to 
grant  chaimel  access  to  certain  protocol  packets,  'llie  latter  packets  are 
usually  much  shorter  than  the  message  packets  so  that  low  throughput  values 
are  acceptable.  At  the  same  time,  the  simle  distributed-control  structure 
ol  the  ORA  is  highly  desirable.  This  is  the  case  when  reservation  access- 
control  disciplines  are  considered  and  (shorter)  reservation  packets  need 
to  be  transmitted  by  the  terminals  (see  [ll-[2]).  I'he  latter  reservation 
packets  can  be  assignetl  periodically  reservation  pericxis  during  which  they 
use  a random-access  proctnlure  to  compete  for  channel  access.  'Hiis  procedure 
clearly  results  in  a ORA  access -control  mechanism,  utilized  by  the  f:imily 
of  reservation  jwckets. 
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The  ;ipprox iiiiatc  throiijiliput  anil  dclay-throut^hput  performance  of  a 
regular  (slotted  AIlUl^)  random -access  jirocedure  have  been  studied  (see 
|e)  (S|  and  references  therein),  assuming  an  approximating  'larkovian 
cliannel  state  pi'oeess.  Certain  dvaiamic  control  schemes  which  staliilize 
the  inherently  unstable  slottctl  ALOHA  channel,  have  also  been  investigated 
(liy  proposing  certain  thresliold  control  schemes,  not  necessarily  optimal, 
and  computing  their  performance  through  the  associated  dyn.miic-progr;imming 
equation,  see  [b],[81). 

In  this  [)aper,  we  {rresent  a precise  study  of  tlie  perfonnance  of  a 
Croup  Random-Access  discipline  and  its  optimal  dsTCimic  control,  llie 
cliannel  is  controlled  so  that  the  minimal  average  message  delay  is  attained, 
under  an  appropriately  prescribed  packet  probability  of  rejection.  'Hie  GR.A 
proceelure  is  shown  to  yield  del  ay -throughput  performance  cliarac- 
teristics  comiiarable  to  those  attained  by  a regular  (slotted  ALOHA)  random- 
access  procetlure,  while  providing  the  network  designer  with  a much  higher 
degree  of  flixibility  in  granting  access  to  different  classes  of  informa- 
tion and  protocol  messages. 

We  note  tluit  our  study  of  the  CRA  procedure  as  an  access-control  dis- 
cipline for  a multi-access  communication  channel,  can  lie  readily  applied 
also  to  non-broadcast  cliannels,  where  a central  controller  (or  other  means) 
is  incoiqxirated  to  provide  the  terminals  witli  the  relevant  (positive  or 
negative)  acknowledgment  and  control  infonivat ion. 

In  Section  1 1 , we  present  the  network  perfomvince  measures  and  the 
slotted  ALOHA  random  access  discipline,  for  the  latter  scheme,  we  indicate 
the  relevant  characteristics  associated  witli  the  evolution  of  the  underlying 
Markov  state  sequence  and  the  computation  of  the  packet  delay  function. 
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Hio  (Ilv\  procedure  is  presented  in  Section  III,  where  we  also  derive  the 
clviractf'r ist  ics  ol'  its  underivinj;  Maikov  state  secjuence  ami  the  related 
lonmilas  vieldini;  the  averaue  packet  delay.  An  optimal  tlynainic  control 
[lolicy  tor  a (iltA  channel  is  character i zetl  ami  studied  in  Section  IV.  .An 
associated  Markov  decision  luohlem  is  shovvii  to  induce  an  optimal  control 
fimction  which  yieUls  the  minimal  average  packet  delay  under  a prescribed 
value  of  ]u-obahility  of  rejection,  llic  resulting  delay-throughput  char- 
acteristics of  the  controlled  (lltA  clvmnel  , under  the  optimal  single- channel 
control  scheme,  are  then  indicated  and  demonstrated  in  a set  of  figures 
presenting  [X'r fomance  cuimes.  The  ajipropriate  preferable  structure 
(threshold  values)  lor  a ('.RA  channel  controller  is  then  noted.  The  con- 
trolled (IRA  chaiuiel  is  shown  to  exhibit  excellent  delay  vs.  throughput 
(or  vs.  probability  of  rejection)  jx^rformance  curves  (even  when  not  all 
the  state  veriables  are  observable)  over  the  whole  range  of  acceptable 
network  traffic  intensities  (or  rejection  probabilities). 
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II.  Network  Perform;mce  Measures  and  the  Regiilar  ( Slotted  ALOH.-\J^ 
l^mdoni  Access  Hisciplinc 

We  consider  a scaichron  i zed  niul  t i -access  broadcast  communication 
channel  ol'  c.ipacity  l!  bps  , a slot  duration  of  t sec.  and  propagation 
delay  of  R slots.  The  channel  serves  a large  community  of  'A  termi- 
nals, generating  new  messages  according  to  a I’oisson  stream  of  intensity 
\ mess. /slot  . bacli  message  is  considered  to  be  a packet  of  fixed 
length  of  u ' hits.  The  packet  transmission  time  is  set  to  be  eejua: 
to  the  slot  duration,  t = (ijh)  ' . 

I'he  perfomunce  of  an  access-control  discipline  applied  to  this 
clrmnel  is  assessed  in  terms  of  the  following  measures.  A performance 
indicator  of  major  import;ince  is  the  steady-state  average  packet  waiting- 
time function  IV  . Tiic  latter  can  be  expressed  as  the  limit  (when  it 
exists) 


K 


lim  N 'li 

^-HX) 


N 

/ IV 

1 ri 
n=l 


(2.1  ) 


wiierc  W'j^  denotes  the  waiting-time  of  the  n th  message  in  the  system. 
Ibis  waiting  time,  expressed  in  terms  of  number  of  slots,  is  measured  from 
tlie  instant  the  packet  is  transmitted  by  its  terminal  (which  liatipens  at 
the  start  of  the  next  slot  following  its  arrival,  thus  not  including  an 
average  of  1/2-slot  delay  between  actual  arrival  and  first  transmission) 
to  the  instant  the  packet  is  successfully  transmitted.  Ibe  overall 
steady-state  average  message  delay  D includes  thus  also  single-slot  and 
R-slot  durations  to  account  for  the  tran.smi ss ion  time  and  propagation 
delay,  respectively,  associated  with  a successful  packet  transmission. 

We  tlius  have , 


I)  = IV  + R + 1 


(2.2) 
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A sue (.c.ss fill  jxicket  transmission  \\’ill  occur  if  the  packet  is  tlie  only  one 
beiny  transmitted  in  its  slot,  while  packet  collisions  occur  if  more  than 
a single  packet  is  heiny  transmitted  in  the  same  slot.  Denotinp,  by  Sj 
tlie  numhei'  of  successful  transmissions  in  the  i-th  slot,  S.  = 0,1,  i>l  , 
the  cliaiuiel  throujtliput  is  j;iven  by 


expressing  the  channel  outjnit  rate  fi.e.,  the  limiting  average  number  of 
successful  packets  ]X?r  slot). 

be  will  note,  in  Section  111,  that  to  stabilize  the  GR.A  channel, 
certain  packets  will  Ivive  to  be  denied  access  and  be  (at  least  temjx-irarily) 
rejected.  Hie  probability  indicating  the  probability  of  packet  rejec- 

tion will  thus  serve  as  anotlier  index  of  [)er foiTiance . .Note  tfuit  if  access 
(eventual  successful  transmission)  is  then  provided  to  all  non-rejected 
(accepted)  packets,  we  will  then  have 

s = (1-P,^)  . (2.4) 

I! Slo t_t e^ j\_b( H L\  j^nd om_- Access  I hocediire 

Ilie  regular  slotted  AL01L\  fSA)  random-access  discipline  operates  as 
fol lows. 

I ’rot  oco  1 ( SA  d_i  sc Jji  1 ijie ) : 

A newly  arrived  [lacket  is  transmitted  by  its  terminal  at  the  start 
of  the  next  slot.  A packet  transmission  (or  ret ran.smi ssion ) which  collides 
with  other  packet  trarrsmissions  is  retransmitted  by  its  tenninal.  Ilie  re- 
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tiaiismiss  ion  slot  is  chosen  .iccordinfi  to  a unifon!)  liistrihution  ov'cr  the 
I,  slots  t'ol  lowing  the  reception  of  the  liroatlcasted  collision  (i.e.,  R 
slots  after  tlie  transmission  of  the  latter  colliding  packet).  Hach 
packet  is  being  retransmitted,  governed  by  the  latter  random  retransmis- 
sion dela\'  procedure,  until  it  is  successful  !>■  transmitted  (avoiding  any 
col  1 is  ions  ) . | 

I'o  indicate  tlie  evolution  of  the  ctiannel  state  process  under  an  SA 
discipline,  we  define  the  following  random  variables.  IVe  let 
and  S,^  denote  tlie  numbers  of  new  arrivals,  total  transmissions,  collisions 
and  successful  transmissions,  respectively,  associated  with  the  n-th  slot. 
We  furtlier  set  to  denote  the  number  of  packets  allocated  for  retrans- 

mission at  the  n-th  slot.  W’o  then  note  that  fAj^,n>l}  is  a sequence 
oi'  i.i.d.  random  variables  governed  by  a Poisson  distribution, 

-A  A*^ 

P(;\^=k)  = e ^ , k=0,l,2,...  . (2.5) 


We  Ivive  for  n>l  , 


N = Z + A = S + R , 
n n n n n 


R„  = n.kn^.i)  , 


.S  = I(N  =1)  , 
n ' n 


(2.6) 

(2.7) 

(2.8) 


wliere  1(A)  is  the  indicator  function  associated  with  event  A , so  that 
I(A)=1  if  A occurs  and  I(A)=0  , otherwise. 

Consider  now  a set  of  K con.secutive  slots  over  which  R trans- 
missions (or  retransmissions)  are  made  according  to  a uniform  distribution. 
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I 

I 


> 


> 


llic  joint  di  strilnit  ion  of  { 1 * ' * ,T*  . ,T^  I , whore  denotes 

tlie  number  of  t r.insmi ss ions  allocateil  to  the  i th  slot  (out  of  these 
K slots  and  of  the  R transmissions),  is  comi'uted  as  follows,  bet 
(II***,  i = l ,2  , . . . ,lt}  he  R i.i.d.  intejter-va  luod  random  variables  uni - 
formly  distributed  over  ll.K]  , 

= K"'  , k=l,2,...,K  . f2.91 


llien  we  have 


■UJ  - 


= I 


i = l 


i=i 


,K 


fz.mi 


nuis,  we  conclutlc  that  the  joint  distribution  of  ^ ^ . . . ,T^  , 

given  R,  is  the  multinomial  distribution  fiij  .n^  , . . . given  by 


r{T*^^=nj,  T*^‘"'=n2,  • . . ,'f**^-nj^jn^+nT+- • -+nj^  = R} 

(K),  , 

= «R 

R!  / 1 

■'W'-'V  vU  ’ 

where  O-n.  R,  i=l,2,...,K  , n ,+'--+n  = R 


(ionsidering  now  the  SA  procedure,  we  let  denote  the  mrnber  of 

n-slot  collisions  allocated  for  retransmission  in  slot  n+R+ j , j=l,2,...,K. 
'nuts,  we  determine  from  ("2 .9)  - ( 2 . 1 1 ) that  the  latter  variables  have  a 
multinomial  conditional  distribution  given  by 


l'fT^'>=n  T^''>=n 

II  n "z 


• . .1I2) 


(2.12) 
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>• 


InIiOI'l' 

1; 

) n.  = l\,  0 II-  R , i = l , . . . ,1.  . 
i = 1 


The  SA  channel  state  process  can  then  he  representeii  as  a vector 


Miikov  chain 

II 

t i\ 

'1}  , 

over  the  space  of  non -negat  i v^e  integers  ./ 

wliere  we  set 

= i z‘"* 

■7(11) 

z(n)  \ 

•••’^n+l,+R(  ’ 

\ n+l  ’ 

“n+Z’' 

and  z|''^  denotes  tlic  overall  nnnher  of  retransmissions  allocated  to  the 
i th  slot  by  any  collisions  occurring  at  the  n-th  slot,  or  earlier 
(i.e.,  at  the  j-th  slot,  with  j'n).  Clearly,  = Z^^^j  since  all 

allocations  for  retransmissions  at  the  (n+l)-st  slot  have  already  been 
m;idc  at  the  time  slot  n . Tlie  transition  probability  function  for  Markov 
cliain  Z is  readily  expressed  in  terms  of  the  following  exinessions . 
t'dven  Z^^  , we  otitain  Z^^^j  by  setting 


„(n+l ) ^ ^(n) 
^n+l  + j ” “^n+l+j 


l^.i-R  , 


(Z 


(n+lj  _ ,lnj  + rf.i) 

^n+l+R+i  ‘'n+l+R+i  n+1  ’ ‘ - 


(Z 


wliere  = 0 , and 

g,j*‘*  (•)  . llius,  we  have 
'Ti+  1 

NJ  = Z \ 

n+1  n+1  ri+1  ’ 


R , - N ,1(N  ,^2)  , 

n+1  n+1  n+1  ’ 


arc  governed  by  distr  ilnit  ion 


•,(j) 

'n+1 


0 , i<j<I,  , if  l^^+i=0 


(2 

(Z 

(Z 


» 


. 1 Aa  ] 
.l.^b) 

.l.V') 
. 1 xil 
.lAc) 
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I 


, i J'i.jVr'')  -4'’'" 


(2.1.30 


wIkm'c  1)  n , 
I 


i = l ■' 


liciuations  (2.13)  tliu.s  specify  tlic  transition  probability  function  for 
tlic  clrimiel  state  sequence  ^ (fiji-  2.1)  . 

by  Hqs.(2.3),  (2.8),  the  channel  throughput  s satisfies 


N 


= Um  N''  y pfN  =1 

N-«o  L ' „ 

n=l 


(2.14; 


If  one  assumes  the  retransmission  counting  variables  to  he  gov'erned 

by  a I’oisson  distribution  with  mean  Z (sec  [3)-[7])  then,  by  (2.1.3c), 

will  follow  a Poisson  distribution  with  mean  N = T+A  . Subsequently, 
we  obtain  by  Ix^.(2.14), 


s = N exp(-N)  ^ c'‘  . (2.15) 

. 1 

It  has  in  fact  been  observed  that  e is  the  maximal  possible  throughput 
of  an  SA  channel.  We  not  in  (2.15)  that  tlie  channel  throughput  increases 
with  N till  N=1  ;uid,  as  N further  increases,  the  channel  throughput 
rapidly  decays  to  zero. 

IXie  to  the  bi-stable  nature  of  the  SA  channel  (sec  [5l,["’l),  the 
underlying  Markov  chain  Z is  readily  noted  to  be  transient,  and  the 
packet  average  delay  1)  subsequently  liecomes  arbitrarily  high,  D=W  = <»  . 
Dclay-tliroughput  perfoimunce  measurements  for  the  .SA  channel  are  many  times 
obtained  by  admitting  new  packets  into  the  channel  only  for  an  appropriate 


» 
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t'initc  duration  Nj  . The  latter  duration  can  l)c  chosen,  assuming 
R|=0  , as 

^ ■»i/{n;  n • 1 , j 1,^}  . (2.K)) 

Tlius,  the  channel  is  allowed  to  admit  new  jiackets  as  lon^  as  no  more  than 
I,j  slot  collisions  are  observed.  (Note  by  (2. IS)  that,  for  Lj  > 1 , the 
resulting  channel  delay-throughput  performance  is  (juite  insensitive  to  the 
value  of  l,j  since,  when  ^ throughjxit  and  message-delay  values 

rapidly  decrease  ;ind  increase,  respectively.)  To  analyze  the  SA  scheme 
with  (2.10)  incoqiorated,  we  replace  in  (2.1.Tc)  with  a controlled 

arrival  variable  A^^|  , n > 1 , given  by 

A^  , if  n < Nj(hj) 

(2.1”) 

0 , if  n • N,(hj)  . 

hollowing  the  Nj-th  slot,  packets  continue  to  be  retransmitted  until 
the  N,-th  slot,  where 

N2  = inf{n:  n 2 Nj , • 

To  obtain  the  average  packet  waiting  time  associated  with  such  a controlled 
SA  channel,  w'e  can  further  assume  that  the  s:ime  channel  operation  is  re- 
pc'ated  following  the  each  o|X'ration  period.  fThis  readily 

follows  by  noting  that  the  resulting  state  process  is  a regenerative  sto- 
chastic process,  with  a regeneration  period  of  length  , and  H(N2)<“  , 
see  [10).) 

(c) 

ITie  resulting  Markov  Chain  ^ is  then  clearly  jx)si tive- recurrent . 

ITie  associated  average  message  waiting-time  function  W is  then  calculated 
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usini;  ;i  ^kirkov  ratio  limit  thoorcm,  (ollowiii)’.  tho  procedure  presented  in 

Ml  . Since  the  lattei  proceiltire  is  utilized  lu'n'  to  analvze  the  (IltA 

sclieme,  we  lu'ielly  siuimuiri ze  it. 

lor  an  irreducible  posit  ive-recurrent  Markov  ciia in  (Z  } or 

~n  ’ n ' ’ 

we  set  N(Z^^,Z^^^)  and  'V(^,Z^_^j)  as  the  number  of  newly  atlmitted  packets  and 
tlie  sum  of  the  waiting-times  of  all  transmitted  packets,  respectively, 
during  the  n-tb  time  period  associated  with  ^ (i.e.,  the  n-th  slot  for 
the  SA  |iroc-edurej . For  our  applications,  the  latter  functions  are  noted 
to  be  time -homogeneous  and  to  depend  only  on  , for  each  n > 1 . 

F'urtlicr  note  that,  as  M ♦ «>  , 


M 


): 

n=l 


N(Z  ,Z 
■n ’ -n+1 


oo 


w . p . 1 . 


Subsequently,  we  can  write 


/ im  rLi. 

M-hjo 

N 


N 

)'  W 

n 


j, 

Lim  ^ 

[ N(Z  ,Z  J 
n=l  ^ ""1 


(2.18) 


witli  probability  one.  We  now  apply  a Markov  ratio  limit  theorem  (see  [9], 
i>.91,  Hieorem  1,  and  [1])  to  the  vector  Markov  chain  {^,n  > 1}  , where 
~ latter  is  an  irreducible  posit iv^e- recurrent  Markov 

chain  with  the  stationar>’  distribution  {7i{j_,j_))  . We  then  conclude  that 


(2.19a) 


where 


» 
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fZ.l'.lh) 


i-j 


h(N(Z^^,Z^^^j)|  = I . 


[2.19c) 


1 


( c ) 

lor  the  S.A  channel  described  by  the  Markov  state  sequence  Z , 
we  liavc 


N'fZ  ,2  ^,  ) = 

-n  -n+1  n 


IV(Z  ,Z  ,)  = R +•••+  I.T 

-n  n+1  n n n r 


(L) 


(2.20a) 

(2.20b) 


In  liq.  (2.20b),  we  have  included  a propagation  delay  of  R slots  for 

each  of  the  colliding  packets,  as  well  as  additional  delay  terms 

incorporating  the  positions  of  the  retransmissions  within  the 

corresponding  set  of  L slots.  V'ariables  are  expressed  by 

(Z.l.'Sb)  in  terms  of  (Z  ,Z  ^,  ) and  their  conditional  distribution  is 

~n  — n+ 1 


given  by  (2.12).  Subsequently,  l:(T 
obtain 


.(i) 


R^*"^)  = L 'r^^^  , so  that  we 

n ^ n ’ 


f;(K(Z  ,Z  ,) 
'■  -n’-n+l 


= [R  + Ui+l)]r^^^ 


(2.21) 


IVe  note  that  since,  for  the  present  case,  we  leave 


N2  N2 

I = y s , 

n n 

n=l  n=l 


we  can  also  set 


N(Z  ,Z  ,.)  = S 
-n’-n+K  n 


(2.22) 
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Using  Ikiuations  (2.20a),  ( 2 . 2 1 ) - (2 . 22  ) in  (2.19),  we  obtain  the  following 
rosu 1 1 . 


» 


Theovem  I . I'or  the  regular  slotted  (AU)Il\)  random-access  scheme,  input- 
controlled  as  represented  by  the  underlying  ‘Lirkov  chain  process  , 
tlie  limiting  average  packet  waiting  time  V.'  is  given  by 


W = [R  + i(lH.)|R*'^^  , 


(2.23) 


( Q 

where  R,  denotes  the  limiting  average  number  of  retransmissions  per 
A 

packet,  and  is  given  by 


rIO  - = 


(2.2  ) 


where  E(R^^^),  1;(A^^^)  and  h(S*^^^)  arc  the  limiting  means  (w.r.t.  the 
measure  ■'Tf2_,j,)  ) of  R^^^  , and  respectively,  and  s ) 

is  the  channel  throughput.  | 


■fheorem  1,  which  serves  as  the  appropriate  version  of  kittle's 

nieorem  for  the  present  scheme,  allows  us  to  compute  the  average  packet 

waiting-time  W from  the  limiting  mean  associated  with  Markov  chain 

. The  latter  mean  can  lx?  conijiuted  by  numerical  methods  or  simply 

(c ) 

through  a simulation  of  ^ fusing  the  recurrence  relationship  in  the 

(c ) 

flow  diagram  of  Fig.  2.1,  with  A^^  replaced  by  , and  appropriate 

restarting  conditions),  'llic  del  ay -throughput  pcrfomuince  of  such  an  SA 
scheme  will  be  presented  in  the  next  Section,  llic  do lay -throughput  perform- 
iince  characteristics  of  this  input -control let!  SA  scheme  are  basically  similar 
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to  those  presented  in  othci  studies  of  SA  schemes  (see  [-’^]-[8]).  llie 
Mirkov  stnte  pi(xess  descrijition  and  analysis  presented  above  serve  to 
present  the  essential  points  relevant  to  our  analysis  of  a (IRA  scheme, 
as  compared  with  those  of  an  SA  procetlure,  as  well  as  to  introduce  and 
and  describe  the  underlying  stochastic  mechanisms  to  be  utilized  here, 
file  CiRA  access-control  scheme  is  presented  in  the  next  section. 


» 


IT 

f 

■■  f 

/ 
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111.  llie  (iroup  R;mdom -Access  Discipline 

To  present  the  (.roup  Random -Access  (C.RA)  procedure,  we  identify 
first  the  sequence  of  periods  * 1)  , durinj;  which  the  group  of 

tenninals  under  consideration  are  allowetl  to  contend  for  cliannel  access. 

The  n-th  iK'riod  is  assumed  to  contain  K successive  channel  slots 

K > 1 , ajid  thus  be  of  duration  Kx  sec.  Hie  distance  between  R^^  and 
R , , measured  in  terms  of  the  number  of  slots  following  R and  pre- 
ceding  taken  to  be  given  by  any  fi.xed  number  of  slots  not 

sraller  tiian  the  propagation  delay  R . With  no  loss  in  generality,  we 
thus  assume  in  the  following  analysis  the  latter  distance  to  be  equal  to 
R , for  any  n,n  > 1 . 

If  N groups  of  terminals  are  set  to  utilize  the  whole  channel  ca- 
pacity, each  using  a GRA  procedure,  channel  time  is  decomposed  into  the 
union  of  N such  picriodic  sequences  {R^^\n  > 1,  l<i<N}  , so  that  R^^^ 

is  followed  bv  R^^  ^\i  < N , and  bv  R^^^  by  R^^] , n > 1 . The  i-th 

group  of  tenninals  with  an  overall  traffic  rate  uses  the  channel  only 

during  periods  n > 1}  , and  thus  does  not  interfere  with  the  trans- 

missions of  any  otlier  grouj5  of  terminals.  Since  the  performace  character- 
istics arc  then  the  same  for  any  group  of  terminals,  except  for  varying 

values  of  A,  R and  K , we  need  to  study  the  performance  of  only  a single 

group  of  terminals  which  we  assume  to  have  an  overall  traffic  intensity  A 
and  to  emit  newly  arriving  packets,  following  Poisson  statistics  (see  (.3.1)), 
only  within  tlie  sequence  of  periods  {R^,n>l}  . 

Alternatively,  if  we  utilize  only  periods  (R^,n'l)  to  serve  a 
family  of  network  terminals  on  a GRA  basis,  we  again  assume  the  latter 
fiimily  to  produce  new  packets  according  to  a Poisson  process  supported  on 
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t 


; i.c.,  the  munber  of  newly  arriving  packets  during  , 

denoted  as  A , is  a I'oisson  variable  with  mean  KA  , 
n ’ 


IMV 


= e 


KA  0^ 


J 


J 


j=(),l 


f^.lj 


with  tliese  A new  arrivals  unifonnlv  distrihuted  over  tlie  K slots  of 
n 

, and  {A^,n>l  } being  a sequence  of  i.i.d.  random-variables,  llius , 
new  packet  arrivals  utilizing  the  GRA  procedure  and  occurring  outside 
iB|^,n>li  , can  be  uniformly  distributed  for  transmission  over  tbe  follow- 
ing period  of  K slots,  and  subsequently  included  in  the  above-mentioned 
arrival  model,  with  A appropriately  comjiutetl  as  the  average  number  of 
new  packet  arrivals  jx'r  utilized  slot,  llie  extra  delay  term,  e.xpressing 
the  packet  waiting-time  from  arrival  until  first  transmission,  is  again 
not  included  in  the  following  waiting  time  and  delay  functions,  but  is 
readily  appropriately  added.  Considering  the  above-mentioned  arrival  pat- 
terns, the  GRA  scheme  operates  as  follows. 

I Yotocol  (GRA  di scipline) : 

1.  Newly  arrived  packets  arc  transmitted  in  the  next  slot. 

2.  I’ackets  colliding  within  B^  arc  retransmitted  within 

Bj^^j,n-1  , at  a slot  determined  by  a uniform  distril>ut ion  over 

fl,K]  . 

7).  liach  packet  is  being  transmitted  and  retransmitted  until  success- 
fully transmitted,  or  until  rejected  from  the  network  by  a network 
control  procedure.  | 


We  note  tliat  step  3 in  the  GRA  protocal  incorporates  the  possibility 
oi  packet  rejection  control  to  yield  finite  packet  average  delay-times, 
as  noted  for  the  SA  scheme.  The  related  optimal  control  arvilysis  will  be 
presented  in  the  next  section.  We  will  present  in  tliis  section  a few  basic 
characteristics  of  the  GRA  scheme. 

As  in  Section  11,  we  let  A , N , R , S and  Z denote  the  numbers 
of  total  new  arrivals,  transmissions,  collisions,  successful  transmissions 
and  packets  allocated  for  retransmission,  respectively,  within  the  n-th 
[x?riod  . 'Ihe  arrival  process  {A^^,n>l}  has  been  characterized  by  fS.l) 
Relationships  (2.b)-(2.8)  hold  here  as  well.  Furthermore,  we  can  write 
here  for  n>l  , 


n+1  n ’ 


(3.2) 


so  that  Iiq.(2.6)  now  becomes 


N ,=R  + A ,=S  ,+R  , 

n+1  n n+1  n+1  n+1 


(3.3) 


Ihe  GRA  cluinnel  state  process  can  be  represented  as  a vector  Mirkov 
chain  ^ = {^,n>l}  , over  the  space  , where  we  set 

A^'^i=l,2,...,K)  , 


and  ;>nd  denote  the  number  of  new  arrivals  and  the  nimiber  of 

ret ran.smiss ions , respectively,  allocated  to  the  i-th  slot  within  Bj^,n>l, 
l^i<K  . Tlie  transition  probability  function  of  ^ 


is  obtaineil  as  follows 
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Wc'  note  that  tlic  arrival  variables  are  statistically  independent  of 

n+ 1 ' 

Z and  are  characterized  by  (3.1).  'llie  variables  depend  on  Z 

only  through  , which  is  given  by 


R = I R 
" j = l " 


(i) 


where  for  each  j,  j = l,2,...,K  , 


[^(J3  = ^-(j)  2)  , 

n n n 


(3.4a) 


(3.4b) 


and 


* 


t 


f 


+ A 


(3) 


(3.4c) 


for  n>l  . Conditional  distribution  (2.12)  is  then  applied  here  to  yield 
multinomial  distribution  (2.11), 


PCldi)  = 
‘ ^ n+1 


l<i<K 


rV-j3 


fK) 

~ R- 


>n,/) 


K 


(3.5) 


where  Osn.sj,  i = l,2,...,K  , J]  n.  = j . 

. ‘ i=l  * 

I:qmitions  (3.1),  (3.4)-(3..S)  thus  yield  the  transition  probability  function 

for  the  Markov  state  chain  Z.  One  observes  tliat  Z , depends  on  Z 

— -n+1  * -n 

only  through  . In  particular,  we  note  tliat  R = {R^,n>l}  is  now  a 
Markov  chain  over  ,/  , with  a transition  probability  function  expressed 
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through  Hqs . ( 3.4)  - (.3.  S)  . A flow  diagram  indicating  the  transition 

R *R  , is  shovoi  in  fig.  3.1  . Also  included  in  the  figure  is  a de- 
n n+1  ^ 

cision  box  involving  the  coimiutat ion  of  the  0-1  control  variable  II 

n+ 1 

as  determined  bv  the  values  of  It  and  II  , II  ^,=MfR  ,11  ).  llie  control 

variable  is  used  to  block  any  new  arrivals,  being  set  equal  to  1 

in  a ixM'iod  during  which  all  arrivals  are  rejected  and  equal  to  0,  otlier- 

wise  , thus  inducing  the  controlled  arrival  variable  (1 -II  )A*--*^  . 

n n n ’ 


'V  = j:, 


(j) 


i = l 


The  throughput  variable  is  given  by 


n+1 


K 

I 

.1  = 1 


=1) 

n+1 


(3.6) 


By  the  multinomial  distribution  (3.5)  and  distribution  (3.1),  we  conclude 
tlvat  (bq.(3.4c))  is  governed  by  a binomial  distribution,  given 


wliere  0-'i<j,  j >0  . Hence,  by  (3. 6) -(3. 7),  we  obtain 


(3.8) 


X “1  "1  "1 

Noting  tliat  xa  ^e  \tn{-A  )]  , for  x?(),asl  , we  obtain  the  HRA  channel  through- 

put s , exiiressing  tlie  average  numtier  of  successful  transmissions  per  slot. 
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upper  tiounded  as 


1 L Mr 

e (K-1)^h[(1  + (K-1)-M  e K 


It  IS  noted  that  the  m;iximal  value  of  h{S  , N ,}  is  attained  at 

n+1  n+1 


, where  is  given  by  the  integer  part  of 

{fn[l  + (K-lJ  . Note  also  that  N*  , >K-1  . function  G,.  is  verv 

II'*'  1 K 

close  to  1 for  anv  K>2  , and  G..-*-  1 as  K . \lso,  K ‘n*  , >1 

N n+1 

as  K » oo  . By  actaal  simulation  of  a GM  cliannel  , we  further  verify 

(see  figures  in  Section  4)  that  we  can  attain  s = — G,.  ^ . We  have 

e N e 

thus  concluded  the  following  result. 


fheorem  2.  A GR;\  scheme  with  K slot  [XTiods  has  a maximal  throughput 

r ' r-  ~ ^ I 

oi  — (j,.  = — . 

e K e ' 


We  note  that,  in  deriving  the  above  maxinvil  throughput  result  in 
(3.0j,  we  Ivive  only  utilized  the  uniform  distribution  associ«te<.i  with 
allocating  retransmissions  and  the  conditional  distribution  of  new  arrivals. 
Otherwise,  the  distribution  of  can  lx?  chosen  arbitrarily,  and  neetl 

not  be  a Poisson  distribution. 

It  is  readily  verified  that  the  state  sequences  ^ and  R are  tran- 
sient, and  thus  l)=W=’'^  , when  the  channel  is  uncontrolled;  i.e.,  wlien 
11^=0, n?l  . I-or  tliat  purpose,  considering  uncontrolled  R with  the  transi- 


tion probabilities  P.j  , note  tlvat 

. I , I'ij  * I’i  . J.  I’ii ' ‘li  ■ 

j’l  + l -*  j<i-' 
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wlioreas  i , p.  increases  tnonotonical ly  to  l-<>x;'(-*K)  > 0 , ami 
q.  decreases  exi)onential  ly  to  0 . Subsequently,  a randori  walk  with  a 
transition  pT'obability  function  . ''here  Mj  . ^ii  + i"  Pj  > 

1’-.=  . 1!^  noted  to  be  transient,  thus  implying  that  R itself 

is  transient. 

To  note  the  evolution  of  the  mean  number  of  ix?ri(xi  collisions,  we 

incorporate  T,q.(3.8)  into  relation  f5.3).  We  then  obtain,  for  n>l  , 

noting  that  N = A + N'  , - S , , 
n+2  n+2  n+1  n+1  ’ 

i:|n  , 

1 n+2 


■Vi } - 'Vi  ■ r)''"*' 


-1 


(3.ina) 


:ind  therefore. 


- ^'(^1^  = 


^^V2^  - 


(3.  mb) 


Also,  since  R^^^j  ~ ^ \i+l  ' '^n+1  ’ ’ 

R +A  -r 


- li 


(3.11) 


Note  in  Iiqs.(3.10)  that,  as  the  total  number  of  period  transmissions 
increases,  the  throughput  rapidly  decreases  and  subsequently 

Wlien  the  channel  is  controlled,  bqs . (3. 10) - (3. 1 1)  still  apply  if  we  replace 
the  arrival  variable  A^  by  the  controlled  arrival  variable  A^  . In  par- 


k 
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ticul;ir,  wc  obtain  from  (.'^.11)  the  conciitional  moans  of  R 


n+1  ’ 


R.  m = i;{R  , R = i , II  , 
I n+1  n n+1 


whoro  i ■(),  i=0,l  , ^iven  by  the  following  Proposition. 


h'ojwyi t ion  1.  l or  a (IRA  sclicmc,  wo  bavo  for  i -0  , 


Kj(i)  = 1 


[■(■O-'l  ■ 


R„m  . ,[l-o-»(l-  i)‘  ‘].  Kx[,.o-»(i-  0‘] 


Prcwf.  liq.lA.l.Aa)  follows  from  (3.11)  when  wc  set  Hq. (3.13b) 

is  obtainotl  by  evaluating  the  expectation  in  (3.11),  with  .A^^^  governed 


by  a Poisson  distribution  with  mean  X and  setting  R^=i  . 


O.E.V. 


liuictions  l^()(i)  -ind  Rj(i)  , given  by  lxis.(3.13),  are  shown  in 
fig.  3.2  . Note  that  R|(i)  = Rp(>)  • > ’P  . Inr  A=0  . lor  any  X>0  , 
we  observe  RqI')  to  be  a iminotonical ly  increasing  fimction  of  i , 
with  a sloi)c  monotonical ly  increasing  to  a rather  constant  value  (almost 
real  line)  within  0<i<2K  . for  large  i , R (i)  = i , as  j ^ R«(i)=l, 

O \ 1 I 

W(;  further  observe  that  Rp(i)  ' R|(i)^KX  for  i>K,  and  that 


KA(l-e  ) = R,,(0)  < R,,(i)  1 i + KA  , 


(3.14) 


f 
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aiul,  by  settinj>  A=0  in  (3.14J,  we  also  note  that 

0 < R^(i)  < i . (3.15j 

ITte  lower  bound  in  (3.14)  clearly  specifies  the  average  number  of  collisions 
;mr)ng  newly  arriving  packets  during  any  period. 

Ilie  computation  of  the  average  packet  waiting-time  (or  any  other 
imment  of  its  waiting-time)  is  now  presented  following  the  procedure  used 
in  .Section  II  here  and  in  [1].  for  this  purj^ose,  we  assume  that  an  appro- 
priate control  function  U^=U(*)  is  chosen,  so  tint  the  Harkov  state  se- 
quences ^ and  R are  irreducible  positive-recurrent,  llie  transition 
probability  functions  and  statioruiry  distributions  of  ^ and  R arc  denoted 
by  (lH(i,j)},  {TT^(i)}  , and  (Rj^(i,j)),  {fTp(i)}  , respectively.  As  in 

Section  II,  we  set  N(Z  ,Z  ,)  and  W(Z  ,Z  ,)  as  the  numlx'r  of  newlv  ad- 

-n'-n+l  -n  -n+r 

mitted  packets  in  and  the  sum  of  the  waiting-times  of  all  packets  trans- 

mitted during  , respectively.  Again,  these  functions  are  noted  to  be 
time -homogeneous  and  to  depend  only  on  f^u’“n+l^’  ‘ Considering  non- 

degenerate controls  that  yield  a packet  rejection  probability  (PjP  less 
tlian  one,  we  have 


M 

I 

n=l 


w.p.  1 . 


Subsequently,  lk^.(2.18)  holds  here  as  well.  Applying  again  a Hirkov  ratio 
limit  theorem,  I:qs.(2.19)  are  obtained  for  con\puting  the  average  packet 
waiting -time  W . 

for  the  controlled  GRA  channel,  we  have 


N(Z  ,Z  , ) = A 
-n’-n+r  n 


(3.16) 


-26- 


w(z  m + + •••  + KT 

-n  -n+l  n L n+1  n+1  1 


nM]  • 


(.3.17) 


AKfz  ) = I [(i-nUN^-''  = i)i(A-^^=nj 
-n  • n n 


(3.18J 


I'lie  first  two  tcims  in  (3.17)  are  the  same  as  those  appearing  in  the  SA 
cf-uinnel  expression  (2.2()b).  The  tliird  term,  unique  to  the  C)R,A  procedure 
and  given  by  (3.18),  accounts  for  the  extra  waiting-time  experienced  by 
a successful  retransmission  within  its  last  period  of  transmission.  .As 
for  the  SA  scheme,  assuming  the  controlled  channel  to  serve  (eventually 
successfully  transmit)  all  admitted  packets,  we  can  also  set 


(3.1?) 


To  evaluate  the  mean  of  (3.17),  we  use  the  multinomial  distribution 
(3.5)  to  determine  that  E(T^^|  R^)  = K ^ , and  subsequently 


Ht'nil  * 


(3.20) 


To  compute  the  steady-state  mean  of  (3.18),  we  not  tlvat  the  limit 


p * tim  r.{I(N^j^  = l)l(A^j^=0)}  , 
n-H»  n n 


(.3.21) 


is  independent  of  j,  IsjsK  , and  yields  the  (steady-state)  probability  of 
a successful  retransmission.  Similarly,  the  limit 


Csa"  ii2'={l(N<J>.l)l(A;[j).|))  , 
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is  independent  of  j,  l<j<k  , and  yields  the  (steady-state)  prohability 
of  successful  first  (newly  arriving)  packet  transmission,  (dearly,  the 
throughput  s=  lim  Ii(S  ) satisfies 


^ ° P.SR  ^ • 

I’robability  p^^^  is  given  by 


(.3.23) 


= lim  I'(A^j^  = l)i;|(l- 

n-^  n K / 71  j 


(3.24) 


since  depends  on  only  through  and  none  of  the  R^_j 

retransmissions  are  allowed  to  be  allocated  to  the  j -th  slot.  The 
proliability  of  a single  controlled  new  packet  arrival  in  a slot  is  given  by 


l^  p(.^J^  = l)  = fl-p,^)Xe'^=  se'^  , 


(3.25) 


wliere 


Pu  = Pfl'  =1)  , 

i\  n ^ 


(3.26) 


is  the  probability  of  packet  rejection,  and  the  (steady-state)  throughput 
s is  given  by 


s = K ^lim  l.(S  ) = A(l-p  ) . 

j^>oo  n K 


(3.27) 


Using  bqs . (3. 21) - (3. 25)  in  bq.(3.18),  and  incorporating  bq.(3.19),  we 
conclude  that 
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f 


I 


- A 
AW  = 


lUAWfZ  J1 


i;[N(z  ,z  ^ 
'■  '-n’-n+ 


-ir  ’ 


,3.28) 


where  the  expectation  o|x^ration  on  the  RIIS  of  (3.28)  is  with  respect  to 

the  conditional  stationary  distribution  of  j giv'cn  . Using  Ixjs. 

(3.1'’),  (3.19)  and  (3.28),  we  obtain  by  Hq.(2.19)  the  formula  for  computing 

the  average  [xacket  waiting-time  W in  a GRA  channel,  in  terms  of  the 

steadv-state  statistics  of  {R  ,n>l)  . 

' n 

’Hieorem  3.  for  a controlled  GRA  chi'umel,  represented  by  an  irreducible 
positive -recurrent  state  sequence  ^ , the  limiting  average  packet  waiting- 

time W is  given  by 

W = [R  + I (1+K)]R^+  AW  (3.29a) 


where 

R.  = s‘^  R = s'^  lim  i;(R^)  , (3.29b) 

A j-j-KX)  n 

and  aW  is  given  by  hq.(3.28).  | 

Regarding  the  extra  packet  waiting-time  term  AW  , we  note  the 
following  points.  Clearly, 

AW  s |(K-1)  . (3.30) 

furthermore,  in  all  practical  applications,  we  will  liave  R<<K  and, 
suljsequently , 
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» 


9 

9 


f.3.31) 


Approxir;iat  ion  (3.31)  yields  approximation  AW^  to  AK  , where 


AW  = AK,  = y(K-l) [ l-e'^(l-K'^R) 1 , 
1 Z 


(3.32J 


;ind  approximation  W^  to  W , given  by 
W = W j = [K  + j(l+K)]s'^  R + AW^ 


(3.33) 


In  all  our  performance  com{iutations , we  have  found  approximation  W.j  in  (2.33) 
to  be  excellent,  generally  yielding  average  waiting-time  results  nearly 
non -distinguishable  frcxii  those  obtained  by  computing  . We  note  that, 
for  computing  W in  (3.29),  only  the  stationary  distribution  of 
i (1^ ,Un)  } is  involved,  wliile  the  major  term  of  (3.29)  requires  only 
the  throughput  s and  the  stationary  mean  IT  of  {R^,n>l}  . For  com- 
puting W^  in  (3.33),  only  means  s and  R are  re<iuircd.  The  latter 
mean  (or  relatetl  distribution)  is  readily  obtained,  for  any  control  func- 
tion, from  the  transition  scheme  of  Fig.  3.1,  using  simple  numerical  compu- 
tation teclmiques  or  a direct  simulation  procedure  of  ((Rj^.U^^)  ,n>l)  . 

A control  .scheme  similar  to  that  presented  in  Section  II,  induced 
by  thresholds  Lp  Nj(Lj^)  (see  hq.(2.16))  and  N£  , is  simple  to  imple- 
ment and  can  also  be  used  here.  Note  that,  under  this  scheme,  the  control 
function  is  given  by 


U ^ = U(R  ,U  ) 

n+1  n’ 


' 0. 

if 

Rn^^i , 

u =n 

n 

1, 

if 

U^=0,1 

1, 

if 

IV,>0  . 

”n=' 

VO. 

if 

VO  . 

(3.34) 


f 


•Vs  indicated  in  Section  2,  this  scheme  will  also  rcjircsent  tlio  waiting- 
time  perfoniiance  of  a GRA  channel  which  stops  admitting  new  packet  arrivals 
when  the  ntmibcr  of  group  retransmissions  surpasses  1,^  and  is  disconnecteti 
as  soon  as  the  latter  numher  Incomes  cero.  llie  delay-througliput  perform- 
ance curves  for  SA  and  GRA  schemes,  under  input -control  function  (3.S4), 
are  showii  in  I'ig.  3.3.  We  assume  K=l,  L^=2K,  R=12  and  choose  values  K=h 
and  K=12  . We  note  that,  as  the  network  traffic  intensity  X is  increased, 
the  cluinnel  throughput  s is  increased  until  its  corresponding  maximal 

value  is  achieved  (note  tliat  we  attain  s s;  e'^  for  K=12).  The  delav- 

max 

throughput  performance  characteristics  under  an  ,SA  or  a GRA  scheme  are 
observed  to  be  similar.  Note  that,  under  input  control  function  (3.34), 
the  operation  of  the  channel  is  terminated  after  a random  number  of  slots 
.N't  , with  the  mean  function  H(N2)‘^°“  rapidly  decreasing  as  X-*t?  ^ . 
Alternatively,  if  the  channel  is  restarted  each  time  following  its  blocking 
[x.'1'iod,  the  packet  probability  of  rejection  Pj^  will  be  noted  to  increase 
as  X is  increased.  A procedure  for  optirial  control  of  a GRA  channel, 
incorporating  both  jxicket  average  time-delay  and  probability  of  rejection 
as  indices  of  performance,  is  developetl  and  studied  in  the  next  section. 


f 
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IV.  t)iitimal  Dvaiainic  Control  of  a GRA  Ctumnel . 

1 Control  1 Vob lem 

I'he  tl>Ti;imics  of  the  GRA  channel,  governed  by  control  sequence 
UJ^^,n>l  } , is  described  in  Fig.  3.1  ;md  F,qs . f 3. 31  - f3 . 5)  , in  terms  of  the 
luiderlying  state  sequence  ^ . Assuming  Markov  chain  { ,11^^)  ,n>l } to 
be  irreducible  pos itive- recurrent , as  is  the  case  for  all  our  applications 
of  interest,  the  stationary  probabilities  of  the  latter  chain  have  been 
noted  to  determine  the  major  channel  indices  of  perfomwnce.  The  average 
jxjcket  waiting-time  W is  the  first  measure  of  performance  of  interest. 

It  is  given  by  (3.29)  and  is  well -approximated  by  of  (3.33),  thus  de- 

])ending  on  the  latter  Markov  cluiin  only  through  R and  throughput  s . 

Ihe  second  measure  of  performance  of  interest  here  is  the  probability  of 
packet  rejection  , given  by  (3.2b)  and  directly  related  to  the  channel 
throughput  s by  bq.(3.27).  IVe  wish  to  obtain  the  control  sequence 
n=^ll^,a>l)  which  will  yield  the  minimum  value  of  packet  average  waiting- 
time (or  delay),  vshile  providing  an  appropriate  prescribed  value  of  packet 
rejection-probability  P^^  (or  ch;mnel  throughput  s ). 

.Note  thiit  rejected  packets  can  be  assumetl  to  be  lost,  or  to  try  again 
to  access  the  cluinnel  following  an  appropriate  random  delay.  The  latter 
is  then  assiimed  to  follow  ;in  cxpont'ntial  distribution  so  that  the  point  pro- 
cess of  new  arrivals  is  still  described  as  Poisson  with  intensity  A . Since 
the  probability  Pj^  for  most  applications  will  be  very  small  (see  latter 
curves),  the  precise  reject  ion- reenter  mechanism  is  not  important  for  the 
present  analysis. 

Assuming  causal  observations  of  the  controlled  channel  state  sequence 
^ are  available  to  the  controller  U , only  Markov  sequence  ( (Rj^.H^^)  ,n>l } 
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needs  to  be  causally  obsei'V'ed,  since  measures  W and  are  considered. 

Hie  set  of  adjiiissible  control  functions  V/  is  not  constrained  and  includes 

all  deterministic  and  randomized  binar>'  functions  operating  on  all  past 

observations  of  ^ ^ • ^aus , tlie  control  variable  operating  at  the 

n-th  slot  is  expressed  in  terms  of  function  * where 

U = f (R,  ,)  , where  R,  = {R  ,l<m<n}  ;ind  II  =fll  ,1-jn-n}  , 

n n l,n’  l,n-l  l,n  m’  1 ,n  m 

;ind  c {0,1}  . Since  only  finite  average  packet  delays  are  of  interest, 

we  need  to  consider  only  the  subset  of  control  disciplines  V/j.  c V/  which 
result  in  a positive -recurrent  controlled  Markov  chain  lR^,n2l)  with 
finite  mean  R < “>  , where 


R = lim  h(R  ) = lim 


'*"1 ' 


(4.1) 


and  a packet  probability  of  rejection  Fp  given  by 


[)  =.  lim 

R 


N'^b  I y UU  =1)  } . 
(n=l  " j 


f4.2) 


The  countable  number  of  feasible  control  functions  u e V/j.  induce 
the  set  of  values  of  attainable  rejection  probabilities.  Thus, 


= (p:p  = Fj^fuJ  , u £ V/j,}  , 


where  denotes  the  rejection  probability  re.sulting  under  control 

function  u . The  minimal  attainable  rejection  probal>ility  is  given  by 


F’p  = tn/(p:p  € .^p} 


(4.4) 


-3:^- 


t 


lor  -I’l^  , wc  set 

= '•'.zx{p:p  p<Pj^},  (4.5) 

as  the  rejection  probalnlity  closest  (from  below)  to  . Given  any  value 
of  rejection  probability  Pj^,  f’p>P^  , we  wish  to  obtain  the  minimal  attain- 
able average  packet  waiting-time  b^fPp)  , given  as 

iV*(P  ) = inf  {iV(u):  P,, (u)  = p(P„)},  (4.6) 

ue  V/g  - « - K 

where  W(u)  denotes  the  average  packet  waiting-time  obtained  when  control 
function  u is  used.  .•\n  optimal  control  fiinction  attaining  waiting-time 
^■*(1’^)  and  yielding  rejection  probability  Pp  is  denoted  by  >_i*(Pp)  • 

To  generate  the  optimal  delay-throughput  curve  of  (4.6),  as  Pp 
varies  between  P°  and  1 , we  can  in  turn  derive  fujtction  ^'^^•(B)  , as 
B varies  in  [0,a>)  ^ where 

4>,.,(B)  = inf  {i\'(y)  + Bl'(u)}  . 

" UeV/j, 

Alteriuitively , since  W is  well -approxinuiteti  by  Wj  of  (3. .3.3)  or,  as 
the  contribution  of  AW  in  (.3.29)  to  W is  generally  sm.aH,  we  can  de- 
rive function  (}>p(B)  , given  as 

4>p(B)  = inf  (R(u)  BI’  (u)}  , pj 

•<  ut  V/p  ’ 

where  B2O  , and  R(u)  denotes  the  limiting  average  number  of  ret ran.smiss ions 


f 
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(4.1)  under  control  function  u . (liven  (i  , let  u*  denote  a control 
fiuu't  ion  attaining  the  minimimi  at  (4.8).  We  have  thus  obtained  the  follow- 
ing result. 


Proposition  2.  For  a (IIU  cliannel,  curve  ctij^CB)  of  Hq.(4.8j  , B^O  , 

induces  the  (.lelay-throughput  curve  W*ri’  ) of  lx(.(4.(i),  1’,, -P”  . Thus, 

K 1\  K 

for  each  B>0  , 


W(u*)  = U'*fP,^*(B))  , 


where 

= P^(up*) 


so  tfiat 


(4.9) 


(1.10) 


u*(Pr*(B))  = Ug*  , (4.11) 

and  1 >Pj^*(B)  >P°  . ^ 

Proof.  For  B^O  , curve  4>,,.(B)  of  Fq.  (4.7)  induces  curve  W*(P,,)  of 
Fq.(4.6),  since  by  (4.7)  control  function  Ug*  attains  the  minimal  average 
waiting-time  value  W(u)  , considering  all  control  functions  u yielding 
l’l^(u)  » • lly  Fx^.(3.33)  for  liT  , we  note  that  W depends  on  R 

and  (through  s , see  Fq.(3.27)).  'Hierefore,  for  any  given  P|,  , IV 
is  minimized  if  and  only  if  the  corresponding  R is  minimized.  Hence, 
curve  4*RfB)  yields  curve  0^^,(B)  and  subsequently  curve  W*(P^)  . '>ne 
readily  verifies,  as  will  be  shown  below,  that  varying  B over  f0,“’) 
covers  the  range  J • 


o.r.p. 
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Proposition  2 indicntcs  that  a solution  to  minimization  [)rohlem  (4.8) 
will  yield  the  optiimil  delay -reject  ion  probability  curve  h^(Pp)  . As  h 
increases,  a solution  to  (3.8)  will  represent  a sclieme  witli  a non-increasint; 
rejection  probability  Pp*fB)  and  a non-decreasing;  average  waiting-time 
fimction  b'*(Bj  = ■ Subsequently,  we  obtain  the  desired  cui-vc 

W*(Pp)  , and  the  optimal  sclieme  u*(Pp)  = u^*  for  some  Pp  1’^  . Note 

also  the  role  of  p in  (.3.8)  as  a penalty  cost  for  packet  rejections. 

(){itimal  control  problem  (4.5)  lias  thus  been  represented  in  the  fonn  of 
a Harkov  Decision  problem  (4.8),  described  as  follows.  The  stochastic  pro- 
cess {R^^,n''l}  , with  state-space  = {0,1,2,...}  is  controlled  by  the 

Dinar)'  control  sequence  {U^,n>ll  , IJ^  e A = (0,1)  . At  time  n , corres- 
pomiing  to  the  end  of  the  n-th  grou]i  , state  is  observed  and 

action  (control)  IJ  = f(R  ,IJ  ) , is  taken.  Subsequent Iv,  a cost 
C(R^,Un)  is  incurred,  and  the  next  state  of  the  process  is  chosen  according 
to  transition  probabilities  controlled  process 

iRj^,n-l)  transition  probability  function  satisfies 


P(R 


. , =J  R,  ,11,  ,R  =i  ,U  = 

n+1  l,n  l,n  n n 


= P..(a) 


(4.12) 


where  a > A = {0,1}  . Under  an  exjiected  average  cost  criterion  (sec,  for 
example,  Il()|-[12]),  an  admissible  control  function  u t y/|  is  chosen  to 
minimize  the  long-run  expected  average  cost  per  unit  time.  I'or  control 
jxilicy  u , the  associated  cost  function  is  then  given  by 


4>,,(i)  = N 


(4.13) 


-7,6- 


lor  i f-  , where  indicates  tli.it  the  conditional  exp.ictation  p.iv'en  u 

IS  used.  ;\  control  function  u*  is  said  to  he  aver.ap.e  cost  optiral  if 


all  i 


(4.11 


Incorporating  Htis.  (4.1)- (4. 2)  in  (4.8),  we  obtain 


B.  y [R  +BU  ] , 

R Ut  y/j;  -In=l  ” ^ ) 


(4.15) 


since  • (-om)iaring  (4.15)  with  (4 . 15)  - (4 . 14) , we  conclude 

tlie  following  result. 


I'ropos it  ion  5.  'Idie  optimal  control  policy  Ug*  yielding  4i|^(6)  for  a (IR-A 
channel,  for  any  3^0  , is  an  average  cost  optinuil  control  policy  for  the 
■Harkov  decision  process  { (R^,U^) ,n>l 1 , under  the  long-run  expected  average 
cost  per  unit  time  measure  (4.13),  with  an  associated  cost  function  C(R^,U^) 
given  by 


t 


= R + eu  . 

n n 


(4.16) 


Results  from  Markov  decision  theory  are  incorporated  in  the  following 

.analysis  to  obtain  the  structure  of  optimal  pol  iev  u * , under  cost  measure 

*0 

(4.13)  and  cost  function  (4.16).  Note  from  (4.16)  that  following  the  n-th 
pericxl  , when  R^^  is  ohservrxi  and  policy  € {0,1}  is  chosen,  the 
associated  cost  function  is  given  by  their  linear  combination  weighted  by 


r 
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6,  C(R  .1)  ) = H +BU  . 

n II  n n 

A [lart icular 1 y important  subclass  of  control  disciplines  is  the 

class  y/  c ■(/  of  statioriarv  control  iiolicies.  A control  function  u is 
s ^ 

said  to  be  statioiwiy  if  it  is  nonrandomi zed  and  it  is  described  by  a 
nuaiiping  ff.):  •'/’*'  A , so  that  • Thus,  under  a stationary  control 

function,  the  control  at  time  n depends  only  on  the  present  obscrv'a- 

tion  . Such  a control  procedure  is  clearly  easily  implementable.  We 
note  that,  imder  a stationary  control  fimcTion  f(-l  , the  controlled  pro- 
cess {R^^,n>U  becomes  a Markov  chain  with  the  transition  probability  func- 
t ions  {P. j ( f f • )) } . 

It  will  be  useful  in  theyfol lowing  analysis  to  consider  the  above 

/ 

optimal  control  problem  foj^ ^ ( R^^  >d^)  ,n>l } , also  under  an  expected  total 
discounted  cost  measure"^  The  latter  is  given,  for  a control  policy  u , by 


V (i)  = sap  E \ y ^ (,:(R  d’  )lR,  = i 
u / U ( ^ n’  n f 1 


(4.17) 


for  y'k)  and  a discount  factor  a e fO,l)  . We  let 


V (i)  = V (i)  . 

a ut'//  u ^ 


i>0  , 


(4.18) 


denote  the  minimal  expected  discounted  cost  function.  A control  policy 
u*  is  said  to  be  a-optiiiual  if 


V *fi)  = V (i)  , 

U*  (X 


for  all  i^O 


(4.19) 


We  wish  to  tierive  and  characterize  the  optimal  control  policy  u* 

■ p 

for  t!\e  Miirkov  decision  process  ,n -1 } , vmder  cost  mcas\ire  (4.  IB), 

or  (4 . 1 B) , ( 4 . 16)  . We  note  that  the  corresivmdi ny  cost  values  become  un- 
boimded  for  control  u < V/j.  . At  tiie  same  time,  the  simj-ile  control  func- 
tion Uj  e y/j.  which  rejects  all  arrivals  clearly  yields  ) = 1 , 

R(Uj)=0  and  subsequently 


4>u*(i)  = 4>r(6)  •- 


(i)  = 6 . 


(4.20) 


rherefore,  the  search  for  an  optiiiuil  control  policy  can  be  reduced  to  sub- 
class y/j.  . Idle  same  conclusion  will  be  obsen'ed  to  hold  under  cost  meas- 
ure I when  u is  taken  to  be  close  enough  to  1. 

We  will  first  establish  tlvit  optimal  poliev  u*  in  fact  exists, 

■ r< 

and  tliat  it  is  furthermore  a stationary  policy.  The  structure  of  the  opti- 
iiuil  policy  will  then  be  characterized.  Tor  that  purjiose,  we  first  consider 
the  i-discounted  cost  problem  (4.18),  and  subsequently  study  the  character- 
istics of  the  a-optimal  policies.  Idie  )K>licy  ohtaincxl  as  a limit  of  the 

a-optinval  jiolicies  is  then  shown  to  yield  the  desired  optimal  control  func- 

* 


tion  Uj^  . 

It  is  well  known  that  a stationary'  a-optinvil  policy  u*(a)  for 

- B 

(4.18)  exists  whenever  cost  fiuiction  C(»)  is  bounded  (see  [101).  However, 
for  our  problem  R^^  , and  tlierefore  ()(•)  , are  unboundetl.  It  has  however 
been  shown  in  (12)  that  an  optimal  stationary  deterministic  policy  for  the 
u-discounted  cost  problem  exists  if  tlie  following  conditions  are  met.  die 
existence  is  required  of  jui  integer  ins'!,  a real -valued  function  g(-)  on 
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t 


f 

\ 


Kith  ^(x)^l  for  all  x e :f  ;md  a real  number  b>0  such  that 


1,  = 


3lil 

x-y 


^'fx,a)|g(x 


-m, 


14. 21  a) 


;md  lor  all  x , n=l,2,...,m  , 

I g{y)”P  (a)  < [gfx)+b]”  . 14.21h) 

afA  ye// 

IVc  now  verify  that  conditions  (4.21)  hold  for  our  problem  and  subsequently 
deduce  tlie  following  result. 

Lemma  1 . Tor  a controlled  GRA  channel,  an  optimal  stationary  fdetermin- 

it 

istic)  control  policy  u„  (a)  exists  for  the  a-discounted  cost  problem 

-p 

(4.18),  a £ fO,l)  . The  minimal  discounted  cost  ^(^(0  is  ibe  unique 
solution  to 


V (i)  = min{C{i,a}  + a ^ V (j)l’..fa)} 
acA  j>0  “ 


= min{\  * * a I V (j)P  la)}  , (4.22) 

3£A  j>0 


the  functional  equation  of  dynamic  programming,  furthermore,  u„*(a) 

-p 

the  [X3licy  which  selects  an  action  minimizing  the  right  side  of  (4.22) 
each  i,i?0  . 


is 

for 


Proof.  The  results  follow  by  [12],  once  conditions  (4.21)  are  verified. 
For  that  purjxjse,  we  choose  g(i)=mzx(i  ,1 ) , i >0  , and  m=l  . Then  we 
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obtain 

L = 3up  {njax  [i  + Ba|g(i)  = sup  [l  + 6i^l  = l+B<<»  , 

i'O  at  A i>l 

verilVing  (4.21a).  For  liq.(4.21bj,  we  obtain 

I 1 g(j)I';.(a)l  = I g(j)P--(0) 

a<A  ja)  j>0  J 

= I jf’ii(O)  < i + KA  + 1 < g(i)  + KA  + 1 , 

j>0 

( 

tor  i>0  , using  upper-bound  (3.14). 

O.L.V. 

It  follows  from  I.emma  1 (see  [12])  that  the  optimal  discounted  cost 
V,^(i)  can  be  com|)uted  by  the  Policy  Improvement  Algorithm  presented  in 
j C.’orollaiy  1.  (See  also  [13]  for  discussions  concerning  piolicy  computations 

using  a policy  imj^rovement  algorithm.) 

» (-OT'ollary  1.  For  a GRA  channel,  the  a-discounted  minimum  cost  function 

V^^(i)  , i>0  , is  given  by 

f V^(i)  = Urn  V^(i,n)  , (4.23) 

n^' 

where  Vj^(i,0)=0  for. each  i,i>0  , and  V^^(i,n+1)  , n>0  , is  computed 
f by  the  recursive  relationship 


f 
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f 


f 


» 


t 


r 


r 


V (i,n+l)  = rnin  { i + + cx  J V n,n)I’..(a)}  . f4.24) 

a.ui,n  j-0  “■ 

We  can  now  jirocced  to  study  tlic  average  cost  problem,  using  the  results 
in  Lenmui  1 and  Corollary'  1. 

Tlieorem  4 . lor  a Glt/\  channel,  a stationary  (deterministiej  optimal  control 
* 

ixilicy  Up  exists,  yielding  a minimum  cost  = 4>jj*rh)  in- 

dependent of  i,  i>0  , satisfying 

(l-a)V  (i)  = lim  fl-nt)V  (0)  . (4.25) 

Proof.  I ncoiyjo rating  Lemma  1 and  Corollary  1,  the  proof  proceeds  following 
a similar  procedure  to  that  used  in  [14].  Considering  the  cx-discounted 
cost  problem,  we  readily  verify  (noting  that  u^*  yields  a positive-recur- 
rent controlled  cluiin)  that 

lim  (l-a)V  (i)  = lim  (l-a)V  (0)  . (4.26) 

a>l  “ a-*\  “ 

lurtliermore,  using  liq.(4.24),  we  will  observe  tliat  there  exists  a station- 
ary policy  u and  an  increasing  sequence  (a^)  with  a^+1  such  that 

4)^(i)  = n-ci^)V  (i)  , (4.27) 

n+«'  n 

for  all  i , i lO  . By  an  Abelian  theorem  (sec  |141,|15))  and  conditions 
(4.21)  for  i?0  and  u f V/  , we  obtain  that 

(J)  (i)  2 lim  (l-fx)V  (i)  . (4.28) 

- a+1  “ 


J 
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llicreforc,  usinj;  relations  (4 . 2h)  - (4 . 28)  and  sequence  used  in 

(4.27),  we  conclude  tliat  for  any  u < V/  , i,>()  , we  liave 


and  therefore 


(4.29) 


O-rCS)  = = 0-(O)  , 


(4..^0) 


ajul 


Ug*  = G . (4.31) 

More  explicitly,  we  will  note  (see  Lemma  2)  by  iterating  Hq.(4.24) 

and  observing  the  resulting  policies  that,  for  a large  enough  value  of 

u,  , the  stationary’  optimal  control  function  Ug*(a)  = u^  is  such 

t)iat  u^^(i)  = l for  any  i>11  , for  some  finite  integer  M . 'nierefore, 

we  can  choose  a sequence  {a^}  with  yielding  a stationary  control 

5X3licy  u *(a  )=vi  , each  n , where  u is  the  scheme  derived  from  u 
■“  p n ot 

as  a>l  . .Subsequently,  using  (4.28),  we  obtain  for  u e V/  , ii-O  , 

4)  (i)  > )V-(i,a  ) = 4i-(i)  , (4.32) 

u n-*«=  n u ’ n-^  u^  ' ’ v 

witli  the  equality  in  (4.32)  followed  by  an  Abelian  theorem  ([15])  stating 
tluat 

N , N 

Ztm(l-oi)  lim  \ = lim  N ^ C , 

(x^l  n=l  N-xx>  n=l 

Therefore,  u„*  = u . 


a.E.p. 
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rheorem  4 shows  that  an  optimal  control  policy  Ug*  exists,  and  can 
he  chosen  to  be  a statioruiry  control  function,  denoted  by  Ug(i)  , i>0  . 
liirtiiennore , the  optiiual  control  scheme  can  be  obtained  l>y  solving  for 
the  rx-discoimted  optimal  scheme,  using  recurrence  relationship  (4.24), 

;uid  then  letting  a-*-!  . We  wrill  use  this  procedure  to  establish  the 
stiucture  of  the  optimal  scheme.  Its  {x-rformance  function  is  then  com- 
puted using  the  results  presented  in  Section  III. 

We  will  not  present  here  the  tedious  algebraic  details  related  to 
ix'rforming  iteration  procedure  (4.24),  but  wd 1 1 indicate  the  relevant  asso- 
ciated results.  To  illustrate  and  explain  the  iteration  re.sults,  we  assume 
first  that  R-(a),  a=0,l  , given  by  bqs.(3.1,3)  can  be  approximated  by  a 
straight  line  given  as 

R^(a)  = ci  + dj^  + d^Cl-a)  , (4.33) 

where  a=0,l  , i^O  , and  c>(),  d.,>0  and  d^  are  appropriate  constants. 

We  note  by  hqs.(3.13)  and  Fig.  3.2  that,  for  i , F.q.(4.33)  yields  an 
excellent  approximation  to  R. (a)  . The  slope  fiuiction 
Aj(a)  ==  R.^j(a)  - Rj(a)  is  also  noted  to  increase  monotonically,  as  i 
increases  for  a=0,l  , to  a value  larger  than  1 and,  only  at  very  high 
values  of  i , A.^(a)  decreases  monotonically  to  its  asynijitotic  value  of 

^ i'^A^(a)  = 1 . Tlierefore,  slope  c in  approx iiTvit ion  (4.33) 

actually  varies  with  i , as  indicated  above.  Applying  F,q.(4.33)  to  com- 
pute V^(i,n)  following  recurrence  relationship  (4.24),  we  note  tliat 
V^(i,n)  is  obtained  to  depend  linearly  on  i . Subsequently,  relation 
(4.33)  can  be  reapplied  in  (4.24)  to  obtain  \'^(i,n+l)  from 
fV^(j,n),  j?0)  . We  then  obtain  V^(i,n)  to  be  given  by,  for  ac<l  , 
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V (i,nj  = A(i,a,n)  + a 1 6-!)('i  ,c  ,n  ) ] , 
^ afA 


where 


(4.34a) 


I a , c , n ) - ti.i  j 


1 - (ntcj 
’ 1 -'ic 


n-2 


(4..34hJ 


Consider  now  the  set  of  states  fi:i>2K'}  . We  have  noted  above  tlvit 


(..(aj  1 for  i >K  , a=0,l  . lurthermorc , we  have 


P..(a)  = 0 , 


for  j^i-K  , i>K  , a=0,l  , 


(4..3.S) 


since,  at  most,  K-1  successful  transmissions  can  occur  when  more  than  K 
transmissions  arc  attempted.  Tlierefore,  in  carr>'ing  iteration  (4.24)  under 
assumption  (4. .33),  we  can  incoriiorate  the  observation  tlvit 


I R (a)P  .(a)  = [ R fa)P. .(a)  , 

j>U  ■>  j2i-K+l  J 


(4..3P) 


when  i22K  . Consequently,  in  evaluating  V^(i,n)  by  (4.24)  for  i>2K  , 
only  functions  {Rj  fa) , j>K)  are  involved.  Since  tlic  latter  fiuictions 
have  a slope  larger  than  one,  we  conclude  tliat  nfoi,c)  = D(a,c,n) 
becomes  arbitrarily  large  for  a close  enough  to  1 ; and  subsequently 
[K-I)(a,c)l  is  noted  to  become  negative,  resulting  in  an  optimal  control 
function  satisfying  the  following  property. 


heima  2.  I'or  a CiRA  channel,  for  any  82:0  , there  exists  an  integer 
M<“'  , such  that  the  a-discounted  optimal  stationarv’  control,  for  any 
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» 


t 


a,  l>rt>a  , for  some  a„  .denoted  by  u.(a,i)  , satisfies 

P P P 

u„(oi,i)  = 1 , for  i -M  , . (4.37a) 

p r 

'fhe  stationary  optinuil  control  ix:>licy  Hg(i)  similarly  satisfies 

u^fi)  = 1 , for  i>M  . (4.37b) 

• p 

Furthermore,  Ms2K  . | 

lor  0<i<2K  , the  appropriate  corresponding  slope  c increases  mono- 
tonically  from  a small  value,  so  that  D(a,c,n)  is  replaced  by  a fiuiction 

l)(u,i,n)  which  is  increasing  monotonically  in  i . 'Idius , letting  n-^  , 

iteration  (4.24)  is  observed  to  yield  function  described  as 

V (i)  = Afi,(i)  + min  a[6-D(a,i)]  . (4. .38) 

" acA 

liuiction  l)(a,i)  is  increasing  monotonically  in  i , for  i-^M  , where  M 
is  an  appropriate  finite  integer.  For  i>M  , any  B''()  , we  liave 

l)(u,i)  > B , for  a>a„  , i?M  , 14.39) 

p 

for  some  Ug  close  enough  to  1 so  that 

l)(a,i)  < oo  if  and  only  if  i<M  . (4.40) 

I’roiierties  (4.39)- (4.40)  are  incorporated  in  Lemma  2.  Using  expressions 


f 
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( 4 . 38) - {4 . 40 ) , we  can  tlms  deduce  the  character  of  the  optimal  control 
p(ilicy  as  siuimirized  in  Theorem  5. 


rheorem  ly.  lor  P d)  , the  optimal  control  function  u^*  attaining 

is  civiracterized  as  a single-threshold  control  function  u *fi) 
l\  p 

given  by 

II,  if  i>KjfB) 

(4.41) 

0,  if  i<K^fB) 

where  u^(-J  is  tlie  unit -step  function.  Threshold  K^(B)  satisfies 


K^(6)  < M , 

for 

Bo  < B 

< B 

max 

Kj(6)  = M , 

for 

6 

- 

(4.42) 

Kj(B)  = 0 , 

for 

6 

< 6„  , 

where 

(4.4.3a) 
(4.4.3b) 


6 = n(a,M-l)  , 

max  a*-l 


8q  = KA{l-ex?;('A)  I , 


and  M«'2K  is  the  integer  appearing  in  Lemma  2. 


» 

0 

i 

I 

% 

!(• 

i » 

i- 


Proof.  Hci.(4.41)  follows,  by  (4.38),  the  monotonicity  of  IHot.i)  for 
i<M  and  relation  (4.39)  or  (4.40)  , for  i .>W  . Tliese  relationships  also 
yield  (4.42)  for  B>Bq  . To  prove  that  Kj(B)=0  for  B'-Bq  , so  that 


■P 

Ug*(i)  = l , each  i , we  note  that  if  denotes  the  average  cost  in 

the  n-th  ixoiod  wtien  u =a  , we  clearly  have 

c^^(O)  - c-^(l)  ^ B,  - PX)  , 

since  expresses  the  average  nunik'r  of  collisions,  during  a period, 

due  to  new  arrivals.  'Hierefore,  we  attain  = 6 by  rejecting  all 

transmissions,  and  K.j^(B)=0  . O.E.V. 

Theorem  5 characterizes  the  stationary  ontimal  control  poliev  u *(i) 

P 

as  a simple  single-thresliold  scheme.  For  pep^  , the  optintil  scheme 
rejects  all  arrivals,  yielding  a packet  rejection  probability  equil  to 
one,  Pj^=l  , and  thus  an  average  waiting-time  1^=0  . As  p is  increased, 
the  threshold  Kj(8)  of  the  associated  optimal  single  threshold  scheme 
is  increased,  to  yield  a lower  value  and  the  corresponding  minimal 

R value,  and  subsequently  minimal  avei'age  packet  waiting- time  W value. 
However,  for  any  value  of  R not  smaller  than  B , Rz-R  , the 
same  optimal  single-threshold  sclieme , with  tlireshold  K.j(R)=M  , is  obtained. 
The  latter  scheme  yields  a packet  rejection  probability  which  is 

clearly  ecpul  to  the  minimal  attainable  value.  Using  lYoposition  2, 

tlie  optimal  control  sclieme  has  tlius  been  shown  to  be  governed  by  the  fol- 
lowing characteristics. 

Corollary  2.  I'or  a CR/\  channel,  there  exists  a stationary  optimal  con- 
trol scheme  Hp(i)  which  yields  the  minimal  R and  values,  under  a 

prescribed  packet  reject i on -probabi  1 ity  Pg=P  . where  l>p'*Pp*^ 


Such  a 
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scheme  assvunes  a 

s i ng  1 e 

threshold  structure,  giv'en  by 

1 

if 

i > K(p) 

u (iP 

= 

! 

f4 

P 

n, 

\ 

if 

i < K(p)  . • 

Threshold 

K 

increases  monotonica  1 ly  from  K(l)=n  to  > 

as  1'  is  decreased  from  1 to  1’  . Rejection  probability  l’  , 

attained  by  the  sinj^lc  threshold  scheme  with  tlircshold  M , is  the  minimum 
attainable  such  probability  for  optimization  problem  (4.8).  | 

It  IS  interesting  to  obsei'vo  that,  as  the  threshold  K of  single- 
threshold scheme  (4.44)  is  increased  from  f)  to  M , the  packet  rejection 
probability  and  average  waiting-time  are  increased  and  decreased,  respec- 
tively. Ikiwever,  a further  increase  of  the  threshold  above  ^1  in  such  a 
scheme  only  increases  while  also  increasing  K , and  is  therefore 

avoided.  'Iliis  phenomenon  is  ex]ilained  by  noting  tliat  , for  such  a scheme 
with  a threshold  higher  than  M , the  time  gained  to  threshold  uperossing 
is  more  than  offset  by  the  extra  time  requircxl  for  threshold  dovvnerossing , 
since  a larger  numlier  of  successful  tran.smissions  is  required  now. 

Pe rformance  Re^u Ij^ 

Ilic  performance  curve  h^(Pj^)  of  the  optinuil  s ingle-tlireshold  scheme 
can  now  be  computed  using  Hc{S.(3.29)  or  (.3.3.3),  with  control  function  (4.44) 
incorjio rated  in  Pig.  3.1  to  yield  the  necessary'  statistics  of  {R^}  (being 
just  s and  R if  (3.33)  is  used),  'llie  latter  have  been  computed  by  a 
straightforward  siimilation  of  Ma'-kov  clviin  {R^,n>U  under  control  func- 
tion (4.44).  Itie  resulting  jH'rformance  curves  are  shown  in  Pigs.  4. 1-4. 2 
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lor  K=12  and  in  l ij>s.  4. 3-4. 4 for  K=9  . In  both  cases,  wc  set  R=12. 
Averajic  packet  delay  (D)  vs.  jiacket  probabi  1 i ty  of  reject  inn 
cui'ves  are  shoMi  in  I'igs.  4.1,  4.3.  For  a fixed  value  of  X , >=11.2,0.3,0.4  , 
ue  note  the  variation  of  D vs.  I’p  as  the  threshold  Kj  of  a single- 
thresliold  scheme  is  increased  from  Kj  = 3 to  Kj  = .30  . The  characteristics 
ot  the  optimal  schemes  as  stated  in  Ilieorem  4 are  well  demonstrated  in 
these  fij’urcs.  Note  that  the  minimal  probability  of  rejection  for  the  GRX 
ch.innel  with  K=12  is  equal  to  a ver>’  small  number  (measured  0)  for 
X=0.1,().2  . and  is  iy’=0.n04  for  >=0.3  and  l’j^'’=0.114  for  >-0.4  . 

For  K=9  , F|^^=0.002  for  >=0.3  , 1^=0. 1 for  >=0.4  , and  is  very 

small  for  >'0.2  . (Note  that,  as  the  Markov  chain  simulation  is  nm  for  a 
large  but  finite  numbt'r  of  slots,  no  threshold  crossings  would  occur  for 
low  A values  and  higii  values,  thus  accounting  for  the  form  of  the 
curves  shown  for  low  > values.)  For  K-12,  the  miniimil  Pj^  values 
are  attained  at  thresholds  Kj=16  and  K^=12  for  ^=0.3  and  >=0.4,  re- 
spectively. For  K=9  , the  thresholds  attaining  Pj^"  are  Kj  = 18  and 
Kj-9  lor  >=0.3  and  >=0.4  , resjH'Ctively.  It  can  be  noted  tlvat  a 
scheme  with  a threshold  yiehls  an  excellent  |)  vs.  Pj^  performance 

over  the  whole  range  of  network  traffic  intensities  (including  generally 
any  > , ()'>r0.4)  yielding  a rejection  probability  not  higher  than  Pj^=0.1  . 

IVe  further  note  tliat  a threshold  value  Kj=M  yielding  ,a  minimal  probabil- 
ity of  rejection  would  not  cause  an  average  packet  delay  mucb  higher  than 
a threshold  value  yielding  a much  higher  I’j^  value.  Therefore,  it  is 
generally  prelerable  to  assign  a threshold  value  of  to  the  GR.A 

cliannel  controller.  For  examjile,  for  K=12,  >=0.3,  for  threshold  values 

Kj=3,6,12  , we  obtain  Pj^  values  of  P|^=n.l()2,  0.0b2,  0.01  and  delay  (O) 


f r 

« 

i'^ 
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values  of  !)=22,25,29  (slot'll,  respectively. 

The  associated  delay  (D)  vs.  throughput  curv'es  are  shouii  in  Fi"S. 

4.2,  4.4.  Note  that,  for  K=12  , the  maximal  throughput  value  of  s=e  ' 
is  attained  at  A=0.8  hy  a scheme  with  threshold  K^=h  , yielding  there- 
fore (at  this  traffic  value)  a rejection  probahility  value  of 
P|^=l-(Ae)'*  = 0.S4  . lor  K=9,  s=e’^  is  attained  at  X=0.f)  hy  a scheme 

with  Kj  = 7 , yielding  Pj^=l-(Xe)  ^ S o.39  . It  is  noted  tliat  over  the 
(practical)  tliroughput  range  Ors-.O..'^  , the  average  packet  delay  varies 
slowly,  and  nearly  linearly,  from  D=l.d(=R+l)  at  s=n  , to  0=20  at 
s=0.2  , to  only  0=25  at  s=0.3  , at  both  K=12  and  K=9  GITA  schemes 
and  any  threshold  value  , with  3'Kj^K  . 

Other  Contro l__^hemes_  for  a GRA  Ghannel 

Mien  the  GR.A  discipline  is  governed  by  a distributed  control  proce- 
dure, applied  over  a broadcast  channel,  the  process  IR^^,nd}  many  times 
cannot  be  observed  by  the  individual  terminals.  Tlien  terminals  generally 
can  ohseive,  in  each  slot,  only  whether  a successful  transmission  or  col- 
lisions liave  occurred.  In  the  latter  case,  the  terminal  obtains  no  infor- 
mation as  to  the  number  of  collisions  involved.  'Ilius,  the  process  observed 
hy  each  terminal  is  given  as  { (S^^  ,C^)  ,n>l } , where  denotes  the  mmiher 

of  successful  transmissions  within  the  n-th  group  , and  gives 

the  total  number  of  slots  in  e.xjx? r i enc i ng  collisions,  and  is  therefore 

given  by 


C 

n 


K 

I 


f.n  _ 


K 


= [ I(N  -2) 

j = l " 


(4.45) 


for  tul  , where  (N 

n 


is  given  hy  Ixi . (.3. 4c ) . Note  that  { ,('^^)  ,n?l ) 
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is  not  a Markov  clviin.  ;\n  optinval  control  procedure  incoqiorating  the 
latter  observation  chain  can  l>e  developed  in  a manner  similar  to  that 
presented  above.  llov\ever,  due  to  the  special  character  of  the  underlying 
state  sequence,  we  can  readily  make  the  following  observations. 

We  note  that  • Within  the  range  of  accejitable  packet  delay 

values,  we  further  exjiect  each  collision  to  involve  an  average  number  of 
transmissions  wliich  is  vcr>'  close  to  2,  and  is  lov%'or  than  5.  Ilius , we 
should  Ivive  R = rC  within  this  range,  with  r=2  . Wlien  R >rC  , the 

mmiber  of  group  collisions  rapidly  increases  and  suhseciuent ly  higher, 
generally  unacceptable,  packet  delay  values  are  obtained.  Ifierefore,  es- 
tiiiuiting  {R^,n>l}  hy  {R^=rC^,n>l}  , we  can  employ  the  ojjtimal  single- 
threshold scheme  developed  above,  llie  latter  scheme,  denoted  by  C , 
now  uses  observations  of  {C^,n>l}  and  a threshold  K,  . We  thus  exjiect 
this  scheme  to  exhibit  a delay-throughput  curve  very  close  to  that  obtained 
by  the  optimal  scheme  which  uses  {R  } observ'at ions  and  threshold  K,  , 
and  serves  as  a lower-bound  to  the  iterformance  curve  of  C.  , with 

Performance  points  for  a single-threshold  scheme  (’  are  shown  in 
figs.  4. 1-4.2  , for  K=R=12  . The  results  completely  verify  the  above- 
mentioned  observations.  The  optimal  performance  jxiints  for  C are  all 
noted  to  lie  on  the  lower-bound  performance  curves  for  the  scheme  using 
{Rj^}  observations,  furthermore,  scheme  C with  threshold  K2=K^/2  is 
noted  to  attain  performance  curves  ver>'  close  to  those  obtained  by  the 
optimal  scheme  using  {R^^}  observations  and  threshold  Kj  , Kj<M  . Only 
when  the  latter  scheme  has  utilized  a threshold  , we  note  that 

sclieme  C would  utilize  threshold  K2>2Kj  . Tlie  latter  sitiuition,  however. 
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represcnts  a range  of  imdcsirable  threshold  values,  since  schemes  using 

lower  thresliold  valut's  yield  lower  jiacket  delays  under  the  s.ime  values 

(see  lig.  4.1).  We  thus  conclude  that  a single-threshold  scheme  using 

{Cj^}  ohscr\’at  ions  ojierates  as  well  as  the  optirmil  single-threshold  scheme 

using  {Rj^}  observations  within  the  acceptable  range  of  h-Pj^  values. 

llie  metlicK.ls  presented  and  used  in  this  paper  can  be  applied  to  study 

a variety  of  other  related  (iR'\  access-control  disciplines,  for  exam{)lc, 

in  certain  applications  we  might  wish  to  reject  certain  colliding  packets 

rather  tlwn  new  transmissions.  We  can  thus  study  a (IRA  scheme  with  a 0-1 

control  fiuiction  UJ  } which  uses  {R  } or  {C  } observations  and  re- 

n n n 

jects,  at  appropriate  times,  all  collisions  within  the  corresponding  period. 
The  i>erformance  analysis  for  such  a scheme  follows  that  presented  in 
Sections  JII-PV'.  In  particular,  we  can  note  that  the  associated  'kirkov 
decision  problem  involves  now  the  cost  function  CfR  ,U  ) = R [1+6U  ] . 
llie  resulting  optimal  single-threshold  scheme,  denoted  by  , is  readily 
sliown  to  Ivive  similar  perfoimvance  characteristics  to  those  indicated  in 
Idieorem  5 iind  Corollary  2.  Performance  jxiints  for  a C^  scheme  for 
A=0.3,  K=R=12  are  shown  in  Pig.  4.1.  The  av'erage  packet  delay  value  here 
incorporates  both  successful  and  rejected  transmissions.  We  note  that  this 
scheme  yields  lower  packet  delay  values  at  higher  rejection  probabilities 
(P|^>().()5)  when  compared  with  the  previous  scheme,  for  rejection  probabili- 
ties 0.014<Pj^s0.05  , comparable  packet  delays  are  attained  by  both  schemes. 

■Scheme  , however,  yields  a minimal  probability  of  rejection  Pj^^^=0.f)14 , 
while  the  previous  scheme  yields  Pj^*^=0.004  . 'Hie  latter  is  thus  iirefer- 
able  at  lower  Pr,  values. 


\ . (.'.one  1 us  i ons 


We  have  presented  and  stiulied  Ciroup  ILandom -Access  access -control 
disciplines  for  a inult  i -access  commiuiication  channel.  A (IRA  scheme  uses 
only  certain  channel  time-periods,  durin^j  which  some  network  terminals 
attempt  to  tr.msmit  their  informat  ion -hearing  packets,  on  a rantiom- 
access  basis.  Hie  channel  can  thus  he  utilized  at  otlier  times  to  grant 
access  to  other  terminals,  or  other  message  types. 

To  stabilize  the  CIRA  channel,  an  appropriate  d>ai;imic  control  proce- 
dure is  applied.  Oie  state  of  the  underlying  channel  state  sequence  is 
observed  by  each  terminal  and  subsequently,  within  certain  periods,  no 
transmissions  are  allowed.  Huring  these  periods,  newly  arriving  packets 
are  thus  rejected.  The  performance  of  a dynamically  controlled  GRA  chan- 
nel is  characterized  in  terms  of  the  average  packet  delay  (D)  and  the 
jiacket  prob.ability  of  rejection  (Pj^l  , or  network  throughput fsj  . ITie 
optimal  control  policy,  yielding  the  minimal  average  packet  delay  under  a 
jirescribed  rejection  probability,  is  derived  and  characterized  by  studying 
the  associated  Markov  decision  process.  A Markov  ratio  limit  theorem  is 
used  to  evaluiite  the  packet  average  waiting-time  function. 

ITie  performance  results  presented  here  demonstrate  the  excellent 
del ay -throughput  performance  of  a GRA  channel,  over  the  acceptable  range 
of  traffic  intensities.  We  further  note  that  a threshold  value  Kj=M  , 
yielding  the  minimal  probability  of  rejection,  is  many  times  a good  choice, 
furthermore,  if  only  the  sequence  fGj^,n>l}  , indicatiiig  the  niraber  of 
colliding  slots  within  a group,  can  be  observed,  as  is  generally  the  case 
for  distriliuted  control  broadcast  channels,  we  have  shown  that  a correspond- 
ing single-threshold  scheme  C!  with  threshold  K2=Kj/2  yields  a nearly 
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optuiuil  del  ay -throughput  ix'rfoniance.  Other  control  schemes  are  noted 
to  he  govemcHl  by  similar  characteristics,  and  analyzed  using  similar 
methotis.  As  for  a slot  ted -;\l/)ll^  (SA)  random-access  procedure,  the  ORA 
scheme  is  shouii  to  allow  a maxinvil  throughput  of  e ^ . We  also  note 
the  del ay -throughput  characteristics  of  a controlled  ORA  channel  to  be 
similar  to  those  of  an  appropriately  controlled  SA  channel.  A GR>\ 
access -control  procedure,  however,  allows  for  a much  higlier  degree  of 
d\TL'imic  and  efficient  utilization  of  a multi -access  channel  which 
utilizes  integrated  random -access , reservation  and  fixed  access-control 
procedures,  or  utilizes  tlie  ORA  scheme  only  to  provide  ch-annel  access 
to  certain  protocol  packets. 
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3 2 Curves  Rnlil  vs  i.  with  Parameter  ■ . where  Rr.li)  = R , (i)  for 
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Fi(|  3 tji’liiy  vs  Pri>b.il)ilit V of  Ke|t“rtion  Curves  for  <i  GHA  Ch>innel  v/ith 
K 9 H 1?,  Under  .t  Sinqie  Threshold  Scheme  with  Threshold  K 
I CoMstcinl  Curves  with  Par.imeter  K,  ere  Shown 
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Fig  4 4 Delay  v$  Throughput  Curves  for  a GRA  Channel  with  K 9,  R 12, 
Unrfer  Single  Threshold  Schemes  with  Threshold  and  Parameter 

Also  Shown  Constant  —A  Curves  for  A • 0.3  ( I and 
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